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/ Justification for the choice : 


Civil engineering is a vast discipline, bridges construction is not an 
exception, and I have always been fascinated on how bridges are getting 
built, lifted up in the sky and linked in between. The texture and the 
architect of them catch my attention, even the feeling of traversing them 
is an adventure itself. 


Bridges are estimated to last between 25 to 80 years depending on 
location and material. However, bridges may age 100 years with proper 
maintenance and rehabilitation. 


This project presents a life-cycle optimization model using a semi- 
Markov process and demonstrates how the proposed method can assist 
highway agencies to make more quantitative and explicit decisions for 
bridge maintenance applied in the State of Texas. 


2 llightlights: 
21 Keywords: 


Bridge maintenance ; Life-cycle optimization ; Semi-markov process ; 


Risks ; Uncertainty ; NBI Database (National Bridge Inventory) 


2.2 Annotations : 
The following symbols are used in this paper: 

X (t) : Markov process state for any time t, 

Pt ; Markov transition probability matrix 

A (t) : Probability Mass Function (PMF) at any time t 

Fi (t): Cumulative Density Function (CDF) of waiting time at any time t 
Si(t) : Survival Function (CDF) of waiting time at any time t 

fi (t) : Probability Density Function of waiting time at any timet 

Re : Repair Effect Matrix 


Di, Ai : Parameters of Weibull Distributions 
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47. Intraductian uf the Problem : 


Highway bridges are vital links in the U.S. transportation system, but a large 
portion of them are deteriorating constantly due to various risks, such as: 


Defective design of bridge; 

Poor quality of construction materials; 

Poor quality control during construction; 

Effect of water on the parts in contact with water; 
Resistance with weathering effect; 

Temperature change; 

High traffic volumes; 

Miscellaneous factor like flood, earthquake.....etc; 


Negligence of minor effects 
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Fig 1: Common bridge deterioration causes 
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Problematic : 


Repairing these critical pieces of infrastructure would require a significant 
investment, but most highway agencies lack the necessary funds to address 
the backlog of bridge repairs and therefore need effective methodologies 
for allocating limited resources efficiently and cost-effectively. 


4, Examination of the method : 


To overcome these limitations, a life-cycle optimization model using a semi- 
Markov process is proposed in this study to make the decision-making 
process of bridge management more quantitative and explicit for highway 
agencies. Various factors are considered in this model, and the bridge 
deterioration is assumed as a semi-Markov process, which means that the 
durations in each condition state, also called state waiting times, are defined 
as random variables with probability distributions (e.g., the well-known 
Weibull distribution). The timing and costs of interventions (maintenance 
activities, rehabilitations, and repairs) in a bridge's life-cycle are determined 
by the proposed model, and the most efficient and cost-effective procedure 
can be selected from several alternative maintenance strategies. 


Compared with the existing models, the proposed model has at least three 
unique features: the impacts of various factors, including traffic volumes (or 
Average Daily Traffic (ADT)), bridge types, construction materials, etc., are 
considered thoroughly; a semi-Markov chain that relaxes the homogeneous 
limitation of traditional Markov transition matrices is adopted herein; and 
a life-cycle cost analysis that considers different repair strategies along the 
planning horizon is integrated with the model. Through this model, highway 
agencies have great potential for optimizing their decisions on structuring 
the bridge life-cycle maintenance plan, leading to cost savings and more 
efficient sustainability of their transportation infrastructure. 


4| The basics: 


In a discrete-time Markov process as a stochastic process with 

states X(t), for any n time points t, t.,..., t, the conditional distribution 

of X(t.) for given values of (X(t.),..., X(tr.)} depends only on X(t), which 
is the most recent known value. This can be stated as: 

P [X (ty) € z4|X(h) = zi X (B) = 25. X (5) = En " 
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When the Markov process goes from state X; to state X, it is said to 
transition from state 1 to state у. A Markov transition probability matrix 
denotes the transition probability from state 1 to state у during time ё, as 
shown below: 
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Пп an n-state space discrete Markov process, the state of the process at any 
time t is typically stochastic and is defined by a Probability Mass Function 
(PMF) that is denoted by an n-dimensional vector A(t). 


ШӘ! i3) 
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Member ағ denotes the probability that the process is in state i at time t. 
The PMF of the process at time (t + k) is obtained: 


Ajttk) = A(t) Pert Pe! ы р-н id 
For a stationary Markov chain, the above equation can be reduced to: 


A(t -- Е) = A(t) P*. (5) 


In which the Markov chain is stationary in time (or homogeneous) and the 
Markov transition probability matrices are constant. 


Usually, under the condition of no interventions (renewals or 
rehabilitations), the process of bridge degradation is unidirectional, 1.е., if 
state 1 denotes good as new and state n denotes failure, then the process 
can move only from state i to state j. Further, it is often assumed that a 
bridge can deteriorate only one state at a time, that is, the bridge will 
deteriorate from state 1 to state 2, then to state 3, and so on to failure. The 
process thus cannot jump from state 1 to state 3 without passing through 
state 2. If a bridge is expected to deteriorate very fast, one can shorten 
transition periods to the extent that realistically only single state 
deterioration is possible in one period. The time period is assumed to be 
one or two years, since highway agencies normally inspect bridges every 
other year to update the NBI dataset. This leads to a relatively simple 
Markov transition probability matrix: 
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47 Semi-Markov Process : 


In the real practice, a bridge deterioration process in which sojourn (or 
waiting) times in any given state are time-dependent distributed random 
variables cannot be captured by a discrete time Markov chain. In this 
regard, a semi-Markov chain with various transition probability matrices 
can relax this limitation and is more suitable to capture the bridge's real 
degradation process. A semi-Markov process is a class of stochastic 
processes that moves from one state to another with the successive states 
visited forming a Markov chain. The process stays in a particular state for a 
random length of time, and its distribution depends on the state and on 
the next state to be visited. 


In а semi-Markov process, T, Т, ..., Т, are random variables denoting the 
sojourn times in states 11, 2... n-1j, respectively. Their corresponding 
Probability Density Functions (PDFs), Cumulative Density Functions 
(CDFs), and Survival Functions (SFs) are thus denoted f(t), F(t), and Si(t). 
Ti, is the time it will take the process to go from state i to state k. In 
addition, fT), F(T), S(T) are the PDF, CDF, and SF of Ту, 
respectively. If the deterioration process is in state 1 at time t, the 
conditional probability that it will transit to the next state in the next time 


step At is given by: 
Pr[X (t+ 1) = 2Х (0 2 1] = ры (0) = £927, (7) 


Where t = O is the time when the process enters into state 1 (i.e., new asset 
— in most cases). It should be noted that At is assumed to be small enough 

to exclude a two-state deterioration. In this case study, At is assumed to be 
one unit (year) and is thus omitted. Similarly, if the process is in state 2 at 

time t, the conditional probability that it will transit to the next state in the 
next time step At is given by: 


Pr[X (t+ 1) 231 (== ры () = A. (8) 
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Noted that in Eq (8), the PDF f, ...(t) pertains to T;..., which is the random 
variable denoting the sum of waiting times in states 1 and 2. Further, the 
denominator expresses the simultaneous condition that T,... < t and T, < t, 
which is equivalent to the condition X (t) -2. In a general form, if the 
deterioration process is in state 7 at time t, the conditional probability that 
it will transit to the next state i + 1 in the next time step At (usually one 
unit (year)) is given by: 


: : Aa | 
Pr [+ At) = i + 1X(t) =i) = mua (0) = DU RAUS (9) 
or Pr[X(t +1) =i + 000) =i] = ры (t) = uL 


(i= 1,2,...,n— 1). 


Eq 9, provides all the transition probabilities pi,i+1(t) to generate the 
transition probability matrix for the semi-Markov process. It is noted that 
these transition probabilities are assumed to be time-dependent, and thus 
the process is non-stationary (or non-homogeneous). Once the transition 
probability matrix is established, the deterioration process can be modeled 
to obtain the PMF of the process at any time t. 


The waiting time T; of the process in any state i is arbitrarily modeled as a 
random variable with a two-parameter Weibull probability distribution. 
Since the PDF (f.(T4)),CDF(Fa(TuJ),and SF(S.(T..)) of the sum of waiting 
times cannot be calculated analytically, a Monte-Carlo simulation needs to 
be implemented to numerically calculate these functions for sums of 
Weibull-distributed random variables Т; according to Eq10; 


F; (t) = Pr[f; < t| = 1 – e- «P^ (10) 
S; (t) = 1— F; (t) = e- 0^ (11) 
fi (t) = BS = yate ou (12) 


The parameters for the deterioration model are based on historical 
observations and condition assessments of bridges since there are 
sufficient historical records in the NBI database. The parameters are then 
derived by Eqi3 ; 


S; (u) = e Pu In [5 (u] = (A) гыз 722. (13) 
ү mun "d ns = Aun (2). 
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where 


= uj] Зер, mu 4 | 
В = ni = 1-8 (u)) ^. (м) 


In the above equations, if the probability оҒ5(и) and S,(v) of being in 
state i at the uth and vth years are known, parameters f; and A; can be 
derived. Once parameters f; and л; are known, the transition probability 
matrix can be established. The determination of these parameters will be 
presented in detail in the case study given later. 


4.3 Те definition of semi-Marknv state : 


According to the FHWA bridge condition rating , five semi-Markov states 
for the degradation of bridges can be defined as follows: *State 1" is good 
as new (above 90% sufficiency), “State 2”(80—90% sufficiency), “State 3” 
(50-80% sufficiency), “State 4” (20-50% sufficiency), and “State 5” (less 
than 20% sufficiency). Also, repair strategies are correspondingly 
determined to be “Do-Nothing”, “Preventative Maintenance, 1.e., 
“Repainting”, “Minor Repair", “Major Repair", and “Replacement”, for 
these five states, respectively. 


4.4 Prediction of life cycle cost : 


The Markov chain can be used to predict future costs of bridge 
rehabilitation activities within the life-cycle term. The expected cost of 
failure at age t is the product of the cost of failure and the probability of 
failure at age t 


E [CF (t)] =cFat. (15) 


It is assumed that the rehabilitation or repair can be modeled by forcing 
the current state of the bridge back to its previous states. This operation 
can be done systematically with the following Markov transition 

matrix /R./: 
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It should be noted that the repair effects are subject to the restrictions of 
the bridge's current conditions (1.е., the bridges in State 2 should have a 
greater likelihood to return to State 1 than those in State 3) and repair 
strategies (1.e., a major repair activity should have a greater likelihood to 
restore bridge conditions than a minor repair activity). Therefore, it is 
reasonable to assume that there are 90%, 8096, and 50% probabilities to 
return to State 1 for bridges in States 3, 4, and 5, respectively. Based on 
these probabilities, the expected costs can be calculated by the following 
equation considering the effects of repair activities: 


E [C* (t)] = DCP AyT* E, (1 а)”, (16) 


Where E[C'(t)] denotes the expected cost of failure at age t; А, denotes the 
repair effect matrix; and 1 denotes the discount rate. The life-cycle costs of 
bridge maintenance based on the proposed model will be discussed in 
detail in the case study given later. 
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4&8 Algorithm: 


*- The algorithm of the proposed model is summarized by the 
following step-by-step procedures and also illustrated in a flowchart 
in Fig2 for better understanding: 


ж Step 1: Define the semi-Markov states in the bridge deterioration 
process according to the FHWA bridge condition rating. 


+ Step 2: Determine the parameters of the Weibull distributions of 
state waiting times by using the NBI historical data or Monte-Carlo 
Simulation if historical data is not readily available. 

* Step 3: Establish the semi-Markov transition probability matrix 
based on the known Weibull-distributions of state waiting times. 

ж. 

+ Step 4: Make bridge maintenance strategies based on existing 
bridge repair techniques and sound engineering judgment. 


ж. Step 5: For each strategy, determine the PMF at the year when 
repair activity occurs by using the transition probability matrices. 


*- Step 6: Calculate the repair costs according to the PMF of the year 
when repair activity occurs. 


ж Step 7: Update the PMF of that year by using the repair matrix to 
reflect the repair effects. 

* - 

*- Step 8: Repeat Step 5—7 if there is another repair activity. 
Otherwise, sum the costs of all repair activities to obtain the life- 
cycle costs of each strategy. 

а. : 

ж. Step 9: Evaluate the repair effects of maintenance strategies and 
then determine the most optimal strategy based on cost and 
structural effect. Within the constraint of limited funding, the most 
optimal strategy should produce the highest structural performance 
in the whole lifespan of bridge while generating the minimum life- 
cycle costs. 
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2. Case study / Application of the algorithm in Texas state : 
d.l Purpose: 


This case study focuses on the performance and maintenance of steel 
bridges carried by local routes in Texas, and its purpose is to illustrate: 1) 
how to apply the proposed model to formulate the semi-Markov chain and 
then to predict the bridge deterioration process based on the model; 2) 
how to calculate the life-cycle costs of different maintenance strategies 
based on the semi-Markov probability matrices; 3) how to evaluate the 
effects of rehabilitation activities and the post-repair behaviors of bridges; 
and 4) how to optimize the life-cycle bridge maintenance based on 
efficacy(or post-repair performance) and funding. In this example, only 
steel bridges without reconstruction are retrieved from the 2012 NBI 
dataset for Texas, which makes the deterioration of bridges in the service 
life a unidirectional decreasing curve. A discount rate of 3.5% is assumed, 
and the analysis period is 75 years, which is long enough to incorporate the 
cost of at least one rehabilitation activity for all alternatives. 


In this case study, five maintenance strategies have been proposed. 
However, for illustrative purposes, only Strategy A is presented in detail. 
Other strategies can be analyzed in the same way, so only the results are 
presented. The analysis procedure includes: 


ж Step 1: Define five semi-Markov states as discussed previously: 
"State 1" is good as new (above 90% sufficiency), "State 2" (50-00% 
sufficiency), "State 3" (50-80% sufficiency), "State 4" (20-50% 
sufficiency), and "State 5" (less than 2096 sufficiency). 


ч Step 2: Determine the parameters of the Weibull distributions of 
state waiting times: the probabilities of any two different years for 
each state can be determined from the 2012 NBI dataset for Texas, 
and then the parameters of the Weibull-distributed holding times 
are summarized in Table 1; 


Pu) » — B5 B: А 
| 1 10 18.92 20 3 70 09856 01677 
2 10 59.46 20 3333 10471 000535 
3 20 5185 a 25 ба 10511 
40) 41 03 50 3333 09398 00221 


Table1; The parameters of weibull-distributed random variables Ti-k. 
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Next, the waiting times T; in every state 1 and the sums of waiting times in 
the various states, Т. are then calculated by these parameters and, (о) and 
(10), as shown in Fig3 and 4 for the PDFs and SDFs, respectively. 
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Fig. 4. Survival distribution functions of cumulative waiting times in various states. 


4 Step 3: Once the Weibull distributions of state waiting times are 
determined, the age-dependent transition probability matrices can 
be calculated by Eq (9) from Year 1 to Year 75. A typical transition 
probability matrix, i.e., the transition matrix between Year 2 and 


Year 3, is shown below: TEN E NET. 


ü 0.9994 0.0006 0 0 
0 1 00 
0 0 1 0 
0 0 0 1 


pii = 


eec 
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If these transition probabilities are determined, the deterioration process 
can be formulated as: 


А) = A (to) Toa, (17) 


Where A(t) is the PMF of the bridge at any time t in the life span. 
For example, the PMF of Year 5 is: 


1 осо 0] [0.9998 0.0002 o d 0 
4 0 1 4d 0 n 0 1 D p 
AG) = А0 [Р =]0 0100 0 0 100 
ket 00010 0 9 010 
ӨШІРІП 1 0 Ü D 7 1 
0.8008 00004 0 о 8 
о 6.9996 0.0004 0 0 
ü 0 1 06 
И; ü 0 1 1 
0 0 D 01 
0,9991 0.0000 0 о ol [0.9983 0.0017 о 0 9 
i} C0904 0.0006 0 DO 1! 0.9093 0,0007 0 ü 
i} 0 1 Пп ü ğ ü 1 0 8 
0 0 о 10 0 2 0 0.9880 0.0120 
ü û о 01 0 Ü T 0 1 
0.9838 0.0062 0 I 0 
0 09971 0.0029 0 D 
-| 0 0 08088 0.0012 0 
0 {1 0 1.8981 0.1518 
0 ii 0 I 1 


+ Step 4: Make bridge maintenance strategies based on available 
techniques and existing experiences. In this case study, five bridge 
maintenance strategies (Strategies A, B, C, D and E) are considered, 
and the detailed repair plans are shown in Fig. 5. For the illustrative 
purpose, only the minor repair cost is included, and other costs are 
assumed to be zero: C^ = [ $0, $0, $29,000, $0, $So[r, C» = [ $0, $0, 
$68,000, $0, $o[r, Cc = [$0, $0, $32,000, $0, So[r, Co = [$0, $0, 
$44,000, $0, $0], C: = [$0, $0, $144,000, $0, ФОР, for Strategies 
A, B, C, D and E, respectively. Noted that the relevant information 
and cost data are obtained from a real bridge repair project and 
more details can be referred to the author's work. 
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Fig. 5. Repair plans of strategies A, B, C, D, and E. 


+ Step 5: For each strategy, determine the PMF at the year when the 
repair occurs by using transition probability matrices. Using 
Strategy A as the example, the first repair activity occurs in Year 10 
and the PMF of five states in Year 10 can be found in Table 1; 


+ Step 6: Assuming the discount rate is 3.5%, calculate the repair cost 
by the PMF of the year when the repair occurs. Based on Strategy A, 
the expected cost in Year 10 can be calculated as: 


E[C?]| = aoci (1+ 3.59) 10 
0.9192 0.0798 0.0010 0 0 
0 0.9684 0.0315 0.0001 0 0 
- 0 0.9917 0.0079 0.0004 | | 29,000 | (14- 3.59) = $3,561. 


0 0 0.7975 0.2025 0 
0 0 0 1 0 
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+ Step 7: Update the PMF of that year by using the repair matrix to 
reflect the repair effect. After the repair of Year 10, the new PMF of 


states will be improved as: 
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Fig. 6. Validation of the proposed deterioration model and the 2012 NBI historical records for 


Texas. 

* Step 8: Sum the costs of all repair activities to obtain the life-cycle 
costs for each repair strategy (Strategies A, B, C, D, and E), as shown 
in Fig7. The order of life-cycle costs from the highest to the lowest 
is: Strategy E» B» D» C» A. 
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Fig. 7. Life-cycle costs for Al five strategies in the 75-year bridge service life. 


v “ 
pl x wc WW xu d ud d d лал МАН БАН uw du d лл dug лал лт МАН МАН МАН МАН МАН МАН МАН МАН МАН МАН gd ал uu us uu su sua uuu uu dg is л uu ds su d МАН d ri лл БАН БАН БАН МАН МАН МАН МИН МАН МАН МИ 


і лі 3 32 3 3 32 3 32 3 32 3 3 32 32 32 3 32 3 3 32 32 32 3 3 32 3 3 3 3 3 3 32 3 3 3 3 32 3 32 3 32 3 3 3 3 32 3 3 3 3 32 3 3 3 3 32 3 3 ізі 3 3 32 3 32 3 3 3 32 3 3 3 3 3 32 3 32 3 3 32 3 3 32 32 3 3 3 32 23 32 32 3 3 3 3 3 JI 


+ Step 9: Evaluate the repair effects of all maintenance strategies and 
then determine the most optimal strategy considering both the 
repair effect (and post-repair performance) and funding (the one 
with the lowest costs). Since the states in the proposed model are 
defined by a Sufficiency Rating (SR) that is mainly comprised of 
structural adequacy, it is reasonable to assume that the bridge, while 
in different states, has different load capacities, i.e., the bridge in 
State 1 has 10096 of the original design capacity, while the bridge in 
State 5 only supports 20% of the design load capacity. The load 
capacities for all five states can be written in the form of a 
matrix: R. = [100%, 80%, 6096, 40%, 20%]. If the PMF (A(1)) of the 
bridge at the year when the repair occurs is known, the repair effect 
can be evaluated by the following equation based on the restored 
load capacity: 


pow = A(t) R (18) 


In which Prev is the restored load capacity after the repair, К, is the defined 
repair effect matrix in terms of load capacity, and A(t) is the PMF of the 
year when the repair is applied. 


Again using Strategy A as an example, the load capacity of the bridge in 
Year 1 can be calculated as: 


10 0 0 0 1005965 
оі D O D ВО 
P = sum (А (1) [Ж] /300%)- | о о 1 о о 6095 | = 100%. 
ооо 1 б 4078 
oa O D O 1 20% 


It should be noted that P is normalized to 100% of the design capacity by 
the division of 30096. 
At Year 10 before the repair, the load capacity is decreased by the 


deterioration: 
(0.0102 0.0799 CCODIC D ü 1005 
D 0.9684 (0.0315 0.000L T 819% 
- D а C U61T 0.0079 пин 6092 | = 97-84%. 
D ü "t “7975 0.2025 409% 
D а ü Ü L 2:058; 


When the first repair is applied, the PMF of the bridge condition is 
improved, and thus the load capacity is increased correspondingly: 


0.99690 0 ни п П 100% 
0.299685 о 0.0032 D n Soc 
= j 0.8891 О амин 07.0016 ОКИ HF = 148.0476. 
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For other repair activities aside from Strategy А, the bridge load capacities 
after the repair can be calculated similarly. Then, the repair effects for all 
five strategies are calculated and presented in Fig8; 





Fig. 8. Life-cycle repair effects for five strategies in the 75-year bridge service life. 


b. Lanclusim : 


According to Fig8, the bridge load capacity decreases continuously during 
the bridge deterioration process without any repair activities. If the repair 
is applied, strategies A, B, C and D can restore the bridge load capacity to 
its original design capacity or even increase it to a higher level during the 
whole life-cycle. The figure indicates that Strategy A improves the bridge to 
its highest load capacity at the end of its service life. However, Strategy E 
cannot restore the bridge to its original capacity during its whole life-cycle. 
The figure also shows that the bridge maintained by Strategy E has a lower 
load capacity than it did originally around 45 years after its construction. 
Considering the life-cycle costs of each strategy, Strategy A is still the most 
optimal. 


7. Application in Morocco : 


In Morocco there is currently some works concerning the Laayoune bridge, 
a part of the Tiznit-Dakhla highway that it is under construction, it will be 
1650 meters in length, costing a total of (MAD 1, 1 billion). The same 
bridge is implementing some optimization technique at its very first states 
one of them is what it was discussed early on. The Data’s are not available 
yet. However it remains a crucial to anticipate future deterioration that 
other bridges in morocco are suffering from especially the old ones. 
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The 1,650 meter long bridge is part of broader efforts to connect Europe with sub-Saharan 
Africa through a high-quality expressway 


There are plenty of mathematical approaches to demonstrate the outcome of 
bridges and their efficiency via differential equations, Markov-chains and 
other... which are typically described over time. They describe how a system 
behaves incepting from an initial given condition within a specified time period 
arriving all the way to a certain state. 

This method use Semi-Markov chain, the usual one which is Markov chain is 
more complicated to determinate the future state because it requires more data's 
over time which something that we don't acquire yet. In Netherlands for instance 
the inspections of bridges are carried out periodically and their results are 
registered in an electronic database. On the basis of visual inspections, bridges 
are rated on a discrete scale ranging from a perfect condition to a very bad 
condition (failure). With that it will be less complicated To determine the 
optimal model parameters, the likelihood function of the data was derived and 
the maximum likelihood estimator was used. The research presents different 
approaches for determining the inspector errors and their results via Hidden 
Markov chain. 
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